Configure Admin Limit Settings

You can configure Admin Limit settings values in the Admin Console.

Steps

1. Sign in to Collibra DQ and click the in the left navigation panel.

2. Click Admin Console.

3. Select Configuration Settings in the left navigation panel.

4. Select Admin Limits.

   

   Note You should generally modify the following Admin Limits settings to prevent too much data from being stored in the database. For example, if you set the datashapelimit to 50 and the datashapelimitui to 25, when you run a check, only 50 shape issues get stored in the database and only the first 25 records display in the UI on the Findings page.

   The following table shows the available settings on the Admin Limits page.

   Setting	Description
   categoricallimit	Limit of categorical outlier storage findings that get stored in the database.
   categoricallimitui	Limit of categorical outlier findings that display in the UI.
   categoricalscore	Default categorical outlier score, per record.
   datashapelimit	Limit of datashape storage findings that get stored in the database.
   datashapelimitui	Limit of datashape findings that display in the UI.
   datashapescore	Default datashape score, per record.
   dupelimit	Limit of dupe storage findings that get stored in the database.
   dupelimitui	Limit of dupe findings that display in the UI.
   dupescore	Default dupe score, per record.
   fpglimit	Limit of frequent pattern mining storage findings that get stored in the database.
   fpglimitui	Limit of frequent pattern mining findings that display in the UI.
   fpgscore	Default frequent pattern mining score, per record.
   histlimit	Limit of histogram storage findings that get stored in the database.
   histlimitui	Limit of histogram findings that display in the UI.
   lookbacklimit	Limit of lookback intervals findings that get stored in the database.
   maxcellcountforparalleljdbc	Maximum number of cells for a DQ scan before it is recommended to use parallel JDBC, which gets stored in the database.
   maxcolumnlimit	Limit of maximum columns display findings that get stored in the database.
   maxconcurrentjobs	Maximum number of Pushdown jobs that can run concurrently.
   maxexecutorcores	Maximum number of executors cores to be set during estimation on a DQ scan, which gets stored in the database.
   maxexecutormemory	Maximum number of executor memory (GB) to be set during estimation on a DQ scan, which gets stored in the database.
   maxnumexecutors	Maximum number of executors to be set during estimation on a DQ scan, which gets stored in the database.
   maxpartitions	Maximum number of partitions to be set during estimation of a DQ scan.
   maxworkermemory	Agent Worker Maximum Memory (WMM)
   maxworkercores	Maximum cores per worker.
   minworkermemory	Agent Worker Minimum Memory (WMI)
   obslimit	Limit of observation storage findings that get stored in the database.
   obslimitui	Limit of observation storage findings that display in the UI.
   obsscore	Default observation score, per record.
   outlierlimit	Limit of outlier findings that get stored in the database.
   outlierlimitui	Limit of outlier findings that get stored in the database.
   outlierscore	Default outlier score, per record.
   partitionautocal	Calculate the number of Spark partitions automatically for optimal performance.
   passfaillimit	Limit of passing or failing threshold findings that get stored in the database.
   pergbpartitions	Per 1 GB memory partitions
   schemascore	Default schema score, per record.
   scorecardsize	Limit of scorecard size display findings that get stored in the database.
   valsrclimit	Limit of validate source storage findings that get stored in the database.
   valsrclimitui	Limit of validate source findings that display in the UI.
   valsrcscore	Default validate source score, per record.

5. To modify values for the admin limits settings, click the icon, next to the setting for which you want to change the value.

   Important If you click the icon, the application setting deletes immediately and no warning prompt displays.

   

   Note Settings with "score" in the setting name represent the default score for that setting's type of findings.

   Warning When you increase the UI display limits, the performance of the web application may decrease.

6. Click Save.

   Tip You can navigate the pages of the admin limits settings by clicking the and icons, located bottom-right of the table.

   To configure the application settings, click Application Config from Configuration Settings in the left navigation panel. For information about how to configure application settings, go to Configure Application Settings.